Large-Scale Traffic Signal Control Using a Novel Multiagent Reinforcement Learning

نویسندگان

چکیده

Finding the optimal signal timing strategy is a difficult task for problem of large-scale traffic control (TSC). Multiagent reinforcement learning (MARL) promising method to solve this problem. However, there still room improvement in extending problems and modeling behaviors other agents each individual agent. In article, new MARL, called cooperative double Q-learning (Co-DQL), proposed, which has several prominent features. It uses highly scalable independent based on estimators upper confidence bound (UCB) policy, can eliminate over-estimation existing traditional while ensuring exploration. mean-field approximation model interaction among agents, thereby making learn better strategy. order improve stability robustness process, we introduce reward allocation mechanism local state sharing method. addition, analyze convergence properties proposed algorithm. Co-DQL applied TSC tested various flow scenarios simulators. The results show that outperforms state-of-the-art decentralized MARL algorithms terms multiple metrics.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multiagent Reinforcement Learning for Urban Traffic Control Using Coordination Graphs

Since traffic jams are ubiquitous in the modern world, optimizing the behavior of traffic lights for efficient traffic flow is a critically important goal. Though most current traffic lights use simple heuristic protocols, more efficient controllers can be discovered automatically via multiagent reinforcement learning, where each agent controls a single traffic light. However, in previous work ...

متن کامل

Using a Deep Reinforcement Learning Agent for Traffic Signal Control

Ensuring transportation systems are efficient is a priority for modern society. Technological advances have made it possible for transportation systems to collect large volumes of varied data on an unprecedented scale. We propose a traffic signal control system which takes advantage of this new, high quality data, with minimal abstraction compared to other proposed systems. We apply modern deep...

متن کامل

Reinforcement Learning For Adaptive Traffic Signal Control

By 2050, two-thirds of the world’s 9.6 billion people will live in urban areas [2]. In many cities, opportunities to expand urban road networks are limited, so existing roads will need to more efficiently accommodate higher volumes of traffic. Consequently, there is a pressing need for technologically viable, low-cost solutions that can work with existing infrastructure to help alleviate increa...

متن کامل

Traffic Light Control by Multiagent Reinforcement Learning Systems

Traffic light control is one of the main means of controlling road traffic. Improving traffic control is important because it can lead to higher traffic throughput and reduced congestion. This chapter describes multiagent reinforcement learning techniques for automatic optimization of traffic light controllers. Such techniques are attractive because they can automatically discover efficient con...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE transactions on cybernetics

سال: 2021

ISSN: ['2168-2275', '2168-2267']

DOI: https://doi.org/10.1109/tcyb.2020.3015811